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ABSTRACT 

There Is a definite need to establish a framework and 
a set of procedures for evaluating school psychological services. 
Studies reported to date tend to be fairly molecular and difficult to 
relate to program changes. The model proposed, a model of system 
evaluation, has the advantage of looking at the "Gestalt,” of 
concerning itself with ways in which the numerous interrelated goals 
tie in with all facets of the organization. In presenting a 
preliminary model, the author defines 4 basic dimensions for 
consideration; ( 1 ) the Influencers of the basic program goals; (2) 
the basic program goals; (3) the program components; and (4) the 
outcomes. He briefly outlines each dimension, observing that the 
value of the model lies in its recognition and utilization of the 
complex Interaction among these several dimensions, (TA) 
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The Evaluotlon of School Psychological Services' 

MarvI n J , FI ne '• 

University of Kansas ' 

The objectives of understanding and Improving any educational 
program are Inextricably related to the evaluation of that program. 

Unfortunately, many evaluations when they do occur are questionable 
due to the lack of objectivity and systematic procedures, Lambert and 
Hartsough (1968) point out that , 

There are no established criteria for evaluating the ’• 

*. V ; effectiveness of school mental health programs. These 

; problems are not unique to school mental health but 
characteristic of those In the general mental health 
field Cp. 486). 

S - " ' 

; ^ The evaluation of school psychological services Is no exception; few 

• ■ , ' , . ; : 

• ‘hr' ’ evaluat are reported In the literature and the ones reported tei|id 

. ‘ j . ; ^ V ■ ■ ' 

to be rather weak, molecular kinds of studies, % . 

There Is a definite need to establish a framework and set of procedures 
■for evaluating school psychological services. This Is not an easy task 
for several basic reasons. School psychological services will vary In 

•content and structure from one school system to another. One psychologlcalV' • ^ 

. . , • . , . ■ .,-•■■■' ■ ■■ 

..services might stress the psychometric examination of special education . 

, children, while another might emphasize teacher consultation or a pre- ' 

. ■ . i ^ ^ ‘ ‘ ^ ^ ^ *. y I -- 

' . _ ; ’ • - ■ , ■ ^ ’‘t . J * 

ventative mental health program. The theoretical orientation of on# ‘ • 

' ■ . . '•■'■■■: r r ■ • • y : ■•: 

. ... . • .-v ■. • 

be quite psychodynamfc whi le another might tend to be 

* * ^ ^ ' ’ ’ : ‘ y . \ ’ A* ♦' i A * 
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behavior modification oriented. The personnel will vary considerably 
from one program to another In terms of kinds of training, number of , . 

personnel, and the psycho log I st«student ratio. Organizational arrangements . . 

- '-T also vary. In some school systems, the psychologist Is attached to ' ; 

t:; ^ t^ superintendent's office, while In others the psychologists might work . , ■ 

;’o a director of pupil personnel who In turn may be two administrative 
■ ; levels removed from the superintendent, ’ . ■ 

■ V Additionally, It Is recognized from the onset that programs need to V: ; ‘ 

' . vafy, depending on the Idiosyncrasies of the particular community, and ! ' . 

that there Is little a priori evidence to support one kind of program over ■ 
another. It then follows that the evaluation process should not be biased 
toward a particular point of view, but should be applicable to different ' ’ 

school psychology programs. - * ■ 

Considering these possible variations In school psychological services, : " ; 

' the prospect of developing a common model evaluate all programs may appear; 

VUs',.;V-:v;T ■ ■ ‘ ■■''V - ^ ■ -T . ’ 

;;:;v and unfeasible, ; , ; v • *' ‘ • ' ■ • . 
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• ■A.w/t- “ to Program Evaluation , *: * , .. ;H ‘ , 

Vf' ^ The literature (Howe, 1955| Kaplan and Sprunger, 1967| Lambert and Hartsough, 

* ‘ ‘ *t' *A ' ^ ^ ■ ' ' = ' * ^ ^ ^ 

t / x . •Sch^t^em ■ , u/- 

• ■ A v',; V'v^;vV ^968| Slotkin, 1966i Scut ber g and Baker, 1968| Gage and Unruh, 1969; Styles,,.'. 

" f/U "‘i.* ** '*,-‘***-' ■ ‘ 

Baker, 1965; Rucker, 1967; Lucas and Jones, 1970) on the evaluation of. • 

services, mental health programs, and teaching, highlights two 
‘, 77 ); * A-v basic evaluation models, Schulberg and' Baker (1968) In particular have ela- ‘ . 

on these two approaches, the goal attainment model and the system model, 

' /. ' • ■■ ' ... \ .0.'. 

^ ” ;T The goal attainment me del Is probably the most popular evaluation : ' 

_ ■procedure 
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ure, within the content of schdol psychoibgteal services. It would; ' 



% y 
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such as 



bo charactQri zed by first establishing specific objectives, such as "o 
koy objective of tho prograrn Is to test children suspected of being 
mentally retarded,** A review of records tho end of the year would 



produce such data as, the number of children tested, the number of tests 
given and tho number of children out of tho total -ostod v;ho v/ero judged 
to be mentally retarded. By comparing these data to the data of prior 
years, or to the data obtained in a neighboring school system, certain 
conclusions could be drawn pertaining to the achievement of this objective 



Contrary to Its popularity, tho goal attainment evaluation Is quite 
narrow In scope, tending to evaluate spociflc goals In Isolation from 
other goals and processes within the organization. The difficulties In 
extending the findings of a goal attainment evaluation Into program change 
have also been discussed CSchulberg end Baker, 1968), ’ 

, The system model may represenf a more viable framework for the 
.evaluation of different kinds of school psychological services, and may 
also lend Itself more effectively to subsequent changes wlfhin the program 



Goal attainment Is stMl considered within the context of this model. 



but the main focus Is on evaluating the program as a social unit. The 



system model evaluation Is more concerned with the ways In whjeh the 
numerous Interrelated goals tie In with all of the facets of the 
organization, from caretaking activities, to professional personnel, to 
inter and Intra staff reletlonships, to feedback mechanisms, and to the 
ways In which The program under sorutlny fits Into tha broader matrix ' 

‘ . • ' ’* - ” » J - ; * * » •, 

of the parent organliatlon, ^ V 



This kind of an evaluation Is certainly more elaborate, complex 
and time-consuming than the goal -attainment ^dol, but Its advantages 



would He In giving a clearer picture of tha componants of school psycho" . . 






logical services I, how they relate to tha total picture of psychological ^ 
services and the total oducatlonal program. Also, Inconsistencies^ 
Inadequacies, and goal failures would be presented In a way that could 
lead to specific changes, . ■ t ,■ 

For example, one objective of the psychological services might be ;• 

. ' 'V"“ 

teacher consultation regarding effective classroom management, A system 

evaluation would attempt to assess (a) the specific nature of the teacher. . 

- ' * 

consultation, (b) the teacher response to the consultation, (c) the • , . v . 

^ ’ f ^ 

preparedness of the psychologists to engage In this Hind of consultation ^ 

■ ■ ' j- , , , 

and (d) how teacher consultation related to the overall objactives of ’ ■ 

school psychological services. The evaluation might disclose that the 

teachers were dissatisfied with the consultation and preferred for the ■„ 

- ' , ■ ' ■ ^ 

psychologist to work with specific "troublemakers” outside of the classroom, 

■ " . ■ • * 5 = 

But It may also be learned that the school psychologists were poorly, 
prepared for their consultation role and that building principals were 
unsympathetic to this approach to service. The system evaluation then 
not only points out that teacher consultation has failed but the tentative, 
basis on which it may have failed. In this Instance, If teacher consultation 



Is to continue, it should be preceded by In-service training of the staff . 

also 

to Increase their own competency In this rolej it would-be important to v 
affect some changes In the attitudes of building principals who currently 

* ’ ' ‘ i * . *• 

were negatively Influencing teacher receptivity to the consultation. 
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I mp I ement I ng a System Eva I uat I on ' • V ^ 

For a system evaluation to be effective there needs to be a discrete •> 
conceptual I Eat Ion of school psychological services as a social system, . 

' ■ • ■ • X. ^ 
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r\^‘. ' Also, In order for the model to be Implemented as an evaluation framework, ," . 
’’package” of Interview and questionnaire procedures should be prepared 

* ’ _r , ' * . . i 

•'.^^rj-i'and readily available. The existence of the model and the Instrumentation, . 

would permit an Individual or team to enter a school system and over a , • , 

> -ft V ^ . - - ■ ■’ 

period of time to conduct an evaluation of school psychological servlcose ■ •; 

. V.V^ evaluation would Include subsequent conferences with the school , - 

- "r , • ' 

^ i: 

personnel Involved as well as a written report. Periodic follow-ups . ■ . 

would also be important as a means of determining If the system evaluation ’ . 

• t 

did actually lead to changes within school psychological services. Such 
an evaluation might take as little as several days or as long as a month 
to occur, but It Is argued that the end results would Justify the 
expenditure of time and money. - • • 

As In Industry, It would be more feasible to have an outsjde. 

r' ■ i z 

Individual or group. to complete the evaluation. The nkel lhood of bias ’ ^ \ 
would be considerably reduced If the evaluation were completed by persons 
not currently associated with the program being evaluated, A university , 
school psychology training program would be an Idea! man-power source . 

for the evaluation. The personnel In the training program have a back- ’ 

» . * s . L 

ground tn school psychology, so they are not strangers to the parameters . .. 

. . ' . < ■ ■ . ■ - 1 ■ % 
an applied school psychological services. These personnel can also . 

^ a greater objectivity because they are not a regular employee of ’ 

..‘the school program. While this university based person may have a personal 

Investment In promoting a certain kind of school psychol^Ical services . 

' ^ system model would .help the evaluation to ' 

' posture of object I VI ty,' The advanced graduate students In a ' 

^ ^ ^ ^ ‘ ; * 1 ‘ ' .V ^ J *’ ■ ' 

ERiC^'- ■' ‘ >'‘v '■ ■' • 
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..unlvorslty school psychology training program could represent a part of, 
. the fnan-pov/er to visit the school system and evaluate the program. This 
. kind of experlenc’ would be Inyaluable to someoi.w who Is training for a 
leadership role In the field of school psychology. 



Development of a_ System Model 

Some efforts have already been made In the development of a system 
model of school psychological services (Figure 1), The preliminary model 

’ Insert Figure 1 here \ 

defines four basic dimensions (a) the Influencers of the basic program 
-goals, (b) the basic program goals, (c) the program components, and Cd) . 
the outcomes. These four areas will be briefly outlined. V • 

(a) Program Influencers : Four key Influences of program goals have 

been Identified, and It Is recognized that they will each possess a 
differential stimulus value In different school systems. But any total 
program evaluation will have to consider the existing pupil needs In the 

school system, administrative expectations, teacher needs and perceptions, 

* - - - 

and of course how the professional school psychologists perceive their role 

and function, ? . f* 

<b) Basic Program Goal s i Aside from, but related to the goal 
Influencers, will be the goals themselves of the psychological services. 
These are expressed Imp 1 1 cl tly through the day by day functioning of the ‘ 

” , , . - * * .’I* 

staff, and explicitly through documentation In the I Iteratur# of the ■ V 
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psychological services and the school administration, • ! ■: J 

• (c) Program Components i. The three nuclear program cwnponents are •. ’ ' * • 






the staff , the profess Iona I functions * and the procedures. The staff 
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. . •, can be examined along the \ irres of professional preparatlpn, specific ...- :■ 

‘■•skills, and kind of cert l-f f oat Ion, The professional functions include / 

;'h- I . 

V.. the various professional rj-^tlyltles of the staff, such as diagnostic ; ' ;0, 

testing, group psychometric screening, teacher consultation, research, 0. •• 

; : ■ . . ■ /; ^ . / 

.".tutorial and counselling activities. The procedures considered will be ’ . v 

.. such things as the referral procedures, data processing and retrieval, ' ' V 
'/• and the basic office managemant of the psychological services, / 

V (d) Outcomes : In relation to the various operations of the psycho- . 

.logical services, there will be numerous outcomes. These can be cpncelved ' • 

••of quantitatively, such as number of children evaluated, number of tests. .••, 

. given, or number of teachers offered consultation, A more qua!ltative ‘ . . , . • • 
assessment would look at the specific ways In which children, teachers 
. and adminlitrators were affected by psychological services, 

There, Is a complex Interaction among these dimensions, and It Is the . -i V 
. recognition of the Interaction that underlies the concept of a system model 
■■ ,, of program evaluation. The Interview-questionnaire procedures are currently .. 

. being prepared, and some pilot evaluations of school psychological services . V 
are planned. It- Is anticipated that modi float I on. and additional development . 

.. of the model and Instrumentation wl 1 1 occur as a result of Information gained^ 



V; +h rough the early attempts, to evaluate programs. 
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It was earlier Indicated that constructive modification of any program ,f . 

■ '• -v.N^jyvy. 

Is hinged to an assessment of the program. This would certainly seem to be . 

( ' case, with school psychological services, where ;so much divergence and ’ ^ 

pertaining to quastlons of ro I #y function effectiveness,^ ; , . 

'■- ■/■ •' Ot-'’' ■ • '.i V' • 
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The pilot effort described in this paper Is an .attempt to develop a viable 
systematic procedure, and hopefully the literature will soon evidence more 
of the needed activity In this area, . ■ V . .. 
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System Model for tie Evaluation of School . 
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